DATA COMMUNICATION APPARATUS FOR PERFORMING BIT RATE 
CONTROL IN REAL-TIME AUDIO-VIDEO COMMUNICATIONS 



BACKGROUND OF THE INVENTION 

1. Field of the Invention: 

The present invention relates to a data communication apparatus 
for performing bit rate control in real-time communications to transmit audio and 
video data, and more particularly to a bit rate control technology for reducing con- 
gestion and utilizing a network efficiently. ) 

2. Description of the Related Art: 

For transmitting audio and video data in real-time over a network, 
the bit rate for the transmission of the audio and video data is controlled depend- 
ing on the congestion on the network. According to a conventional bit rate control 
process, the bit rate is controlled using a packet loss rate and a round-trip time 
(RTT) that are obtained from RTCP (RTP Control Protocol) used in the real-time 
communication protocol RTP (Real-time Transport Protocol) specified by the IETF 
(Internet Engineering Task Force) RFC 1889, for example. 

According to the above conventional bit rate control process, the bit 
rate is controlled such that it is increased until the packet loss rate and the RTT 
exceed predetermined threshold values, respectively, and it is reduced when the 
packet loss rate and the RTT exceed the predetermined threshold values. 

Japanese laid-open patent publication No. 1 1-308271 discloses a. 
bit rate control process for calculating an amount of data to be buffered in a net- 
work using an RTT and controlling the bit rate according to the following equation 
(1) in order to cause the amount of data to have a desired value: 
• " ' Rnew = Rcur + C*(BUFdes - BUFcur) : - (1) 



where Rnew represents a newly determined bit rate, Rcur a current bit rate, BUF- 
des and BUFcur a target value and a current value, respectively, for the amount of 
data buffered in the network, and C a suitable constant. 

According to the disclosed bit rate control process, the bit rate is 
5 controlled by only an integral process which increases or reduces the present bit 
rate using the difference between an observed value and a target value. How- 
ever, the bit rate control process based on the integral process does not only en- 
sure stability, tending to allow the bit rate to be oscillated, rather than converged, 
even if the network is in a steady state. The oscillating bit rate is responsible for 
10 deteriorating the quality of audio and video data of contents that are transmitted 
over the network. . 

SUMMARY OF THE INVENTION 
It is therefore an object of the present invention to provide a data 
communication apparatus for performing stable bit rate control to transmit high- 
15 quality audio and video data in a real-time audio-video communication system. 

A first data communication apparatus according to the present in- 
vention has means for obtaining an index representative of a state of a network, 
and means for controlling a bit rate according to a proportional process and an 
integral process on the difference between a target value for the index and an ob- 
20 served value of the index. 

A second data communication apparatus according to the present 
invention resides in that in the first data communication apparatus, the index 
comprises an amount of data buffered in the network. 

A third data communication apparatus according to thie present in- 
25 vention resides in that the second data communication apparatus further com- 
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prises means for calculating a round-trip time over the network, and means for 
calculating the amount of data using the round-trip time. 

A fourth data communication apparatus according to the present 
invention resides in that the first or second data communication apparatus further 
5 comprises means for transmitting transmission data with serial numbers assigned 
thereto in a sequence of the transmitted data, means for returning a reception re- 
port to which the serial numbers assigned to received data are assigned, and 
means for receiving the reception report and using information about data trans- 
mitted after the transmission data is transmitted until the reception report is re- 
10 ceived, as the observed value of the amount of data. 

A fifth data communication apparatus according to the present in- 
vention resides in that in the fourth data communication apparatus, the informa- 
tion about the transmitted data comprises an amount of the transmitted data. 

A sixth data communication apparatus according to the present in- 
15 vention resides in that any one of the first through fifth data communication appa- 
ratus is arranged for transmitting data of audio and video signals encoded in real- 
time at a bit rate which is controlled based on the state of the network. 

A seventh data communication apparatus according to the present 
invention resides in that any one of the first through fifth data communication ap- 
20 paratus is arranged for preparing a plurality of data of audio and video signals en- 
coded at different bit rates and transmitting the data at a bit rate determined 
based on the result of a bit rate control process. 

An eighth data communication apparatus according to the present 
invention resides in that in any one of the first through seventh data communica- 
25 tion apparatus, the means for controlling the bit rate comprises means for using, 
as the bit rate, the sum of a value proportional to the difference between the target 
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value for the index and the observed value of the index, and a value produced by 
multiplying an integral of the difference by a constant. 

The above and other objects, features, and advantages of the pre- 
sent invention will become apparent from the following description with reference 
5 to the accompanying drawings which illustrate an example of the present inven- 
tion. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram of a data communication apparatus ac- 
cording to an embodiment of the present invention; 
10 Fig. 2 is a block diagram of a bit rate controller in the data commu- 

, nication apparatus; 

Fig. 3 is a block diagram showing a scheme for simulating a bit rate 
control process according to the present invention; 

Fig. 4 is a block diagram showing a scheme for simulating a con- 
15 ventional bit rate control process; and 

Fig. 5 is a diagram showing the results of experiments on the 
schemes for simulating the bit rate control process according to the present inven- 
tion and the conventional bit rate control process. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 As shown in Fig. 1 , a data communication apparatus according to 

an embodiment of the present invention comprises transmitting apparatus 100 
having data generator 101 , bit rate controller 102, data transmitter 103, and 
reception report receiver 104, and receiving apparatus 105 having data receiver 
106, data decoder 107, and reception report transmitter 108. 
25 General operation of the data communication apparatus will briefly 

be described below. Transmitting apparatus 100 controls a bit rate for audio data 
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and/or video data to be transmitted at an appropriate value based on information 
about a network that is sent from receiving apparatus 1 05, and sends the con- 
trolled bit rate to receiving apparatus 105. Receiving apparatus 105 receives the 
audio data and/or video data transmitted from transmitting apparatus 100, de- 
5 codes the received audio data and/or video data into an audio and/or video signal, 
and sends the information about the network to transmitting apparatus 1 00. 

Operation of the data communication apparatus will briefly be de- 
scribed in detail below with reference to Figs. 1 and 2. 

First, a bit rate control process will be described below. Bit rate 

10 controller 102 calculates a bit rate for data to be transmitted to the network based 
on an observed value of data buffered in the network which has been obtained 
from reception report receiver 104, and supplies the calculated bit rate to data 
generator 101 and data transmitter 103. 

Fig. 2 shows a detailed arrangement of bit rate controller 1 02. In 

15 Fig. 2, an adder 201 calculates the difference e(n) between an amount y(n) of . 
data buffered in the network that is input at time n and a target value r. Target 
value r represents a value of 100000 bits, for example. The difference e(n) is 
supplied to proportional circuit 207 which comprises, multiplier 205 and also to in- 
tegral circuit 208 which comprises adder 202, delay unit 206, and multiplier 203. 

20 In proportional circuit 207, multiplier 205 multiplies the difference 

e(n) by a constant Kp. The product is output from proportional circuit 207 to adder 
204. In integral circuit 208, the difference e(n) and a past output of adder 202 that 
has been delayed by delay unit 206 are input to and added by adder 202. Adder 
202 outputs the sum to multiplier 203, which multiplies the sum by a constant Kj. 

25 The product is output from multiplier 203 to adder 204. The constants Kp, K| are 
values that determines the characteristics of the bit rate control process. For ex- 
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ample, K P = 2 and K| = 1 . Adder 204 adds the outputs from proportional circuit 
207 and integral circuit 208, and outputs the sum as a bit rate u(n) at which data is 
to be transmitted to the network. 

A process of transmitting and receiving audio and video data will be 
5 described below with reference to Fig. 1 . Bit rate controller 102 inputs a deter- 
mined bit rate to data generator 101. Data generator 1 01 generates audio and 
video data to be transmitted based oh. the bit rate determined by bit rate controller 
1 02, and outputs the generated audio and video data to data transmitter 1 03. 
Data generator 101 operates alternatively in two modes. In one mode, data gen- 

10 erator 101 outputs, in real-time, encoded data of audio and video signals at a 
given bit rate (or a value close to a given bit rate). In the other mode, data gen- 
erator 101 outputs data closest to a given bit rate, of a plurality of data that have 
been encoded at different bit rates. 

Data transmitter 1 03 transmits the audio and video data generated 

15 by data generator 1 01 , at the bit rate based on which the audio and video data 
have been encoded, to the network. Data receiver 106 receives the audio and 
video data, and outputs the received audio and video data to data decoder 1 07. 
Data decoder 107 decodes the audio and video data into audio and video signals, 
and outputs the audio and video signals. 

20 Processes of obtaining an amount of data buffered in the network 

will be described below. The processes include a process of obtaining a buffered 
amount of data based on the product of an RTT and the bit rate at which the data 
have been transmitted to the network, and a process of measuring an amount of 
data transmitted until a reception report on a transmitted packet is obtained. 

25 First, the process of obtaining a buffered amount of data based on 

the product of an RTT and the bit rate at which the data have been transmitted to 
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the network will be described below. An RTT may be obtained by a process ac- 
cording to the IETF RFC 1889 referred to above. First, data transmitter 103 in 
transmitting apparatus 1 00 transmits a transmission report where the present time 
is described as a transmission report transmission time Ts through the network to 
5 receiving apparatus 1 05. 

When data receiver 106 in receiving apparatus 105 receives the 
transmission report, it sends the transmission report to reception report transmitter 
1 08. Reception report transmitter 1 08 then sends a reception report which de- 
scribes the time T s described in the received transmission report and a time pe- 

10 riod Tm that is consumed after the transmission report is received until the recep- 
tion report is transmitted, through the network to transmitting apparatus 100. 

In transmitting apparatus 100, reception report receiver 104 calcu- 
lates an RTT according to the equation (2) shown below, using a time T r when the 
reception report is received and the time T s and the time period T m described in 

15 the reception report. Reception report receiver 1 04 also obtains the bit rate at 
which the data has been transmitted to the network from the reception of a pre- 
ceding reception report up to the present time, from data transmitter 103, and 
supplies the product of the obtained bit rate and the calculated RTT as an ob- 
served value of the amount of data buffered in the network, to bit rate controller 

20 102. 

RTT = T s - T m - T r (2) 
An interval of time at which the transmission report and the recep- 
tion report are transmitted is adjusted to about 5 % of the bit rate of the audio and 
video data such that those transmission and reception reports will not pose an ex- 
25 cessive burden on the network. 
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The process of measuring an amount of data transmitted until a re- 
ception report on a transmitted packet is obtained will be described below. When 
data transmitter 1 03 in transmitting apparatus 100 transmits audio and video data, 
data transmitter 103 assigns inherent serial numbers (sequence numbers) to re- 
spective packets and sends them to the network, and also outputs the sequence 
numbers and the transmitted amount of data to reception report receiver 104. 
Data receiver 106 in receiving apparatus 105 outputs the sequence numbers as- 
signed to the received data to reception report transmitter 1 08. 

Reception report transmitter 1 08 transmits a reception report to 
which the input sequence numbers are assigned to the network. Reception report 
receiver 104 in transmitting apparatus 100 outputs the total amount of data trans- 
mitted by data transmitter 103 from the sequence numbers assigned to the recep- 
tion report up to the latest sequence number, to bit rate controller 102. 

Details of bit rate controller 1 02 will be described below. Fig. 3 
shows in block form a scheme for simulating the bit rate control process according 
to the present invention at discrete time intervals T in a network having a band 
Bbps. Fig. 4 shows in block form a scheme for simulating a conventional bit rate 
control process. As can be seen from Fig. 4, the conventional bit rate control 
process lacks a proportional process. U P i(z), Ui(z) representing Z-transforms of a 
bit rate u(n) in Figs. 3 and 4 are expressed by the following equations (3), (4), re- 
spectively: 

U P ,(z) = {(1-z)Kp-r - (1-z)Kp-BT + (BT-r(1-z))K,}/{(1-z) 2 - (1-z)K P > K,} (3) 
U,(z) = K,(B-(1-z)r)/{(1-z) 2 + K,} (4) 

The poles of the equation (4) are expressed by: 

z = 1 ±V(K,) (5) 



and are present necessarily outside of the unit circle. Therefore, the conventional 
bit rate control process does not ensure bit rate control stability. In the equation 
(5), V(Ki) represents the square root of Kj. According to the equation (3), the dou- 
ble poles are present within the unit circle if K P , K t are set to satisfy the condition 
5 represented by the equation (6) shown below. Therefore, the bit rate control 
process according to the present invention ensures bit rate control stability. 
K P 2 -4K, = 0,0<Kp<S2 (6) 

Advantages of the present invention will be described below based 
on the results of experiments on the simulating schemes shown in Figs. 3 and 4. 
10 The experiments were conducted on the simulating schemes under the following 
conditions: 

T = 0.001 sec, B = 1 Mbps, KP = 2, Kl = 1 
; Fig. 5 shows the experimental results which indicate that whereas 
the bit rate is oscillating according to the conventional bit rate control process, the 
15 bit rate is converged by the bit rate control process according to the present 
invention. 

According to the present invention, since the bit rate is controlled in 
view of the proportional process and the integral process that are effected on the 
difference between the observed value and the target value, the bit rate is pre- 

20 vented from oscillating. Accordingly, audio and video data are prevented from 

suffering a quality reduction due to bit rate oscillations in real-time audio and video 
communications. Because the bit rate is converged, the load on the network is 
stabilized. Consequently, the data communication apparatus according to the 
present invention is effective for use in general data communications. 

25 While a preferred embodiment of the present invention has been 

described using specific terms, such description is for illustrative purposes only, - 
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and it is to be understood that changes and variations may be made without de- 
parting from the spirit or scope of the following claims. 
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